Partial Least Squares Random Forest Ensemble Regression as a Soft Sensor
نویسندگان
چکیده
Six simple, dynamic soft sensor methodologies with two update conditions were compared on two experimentally-obtained datasets and one simulated dataset. The soft sensors investigated were: moving window partial least squares regression (and a recursive variant), moving window random forest regression, feedforward neural networks, mean moving window, and a novel random forest partial least squares regression ensemble (RF-PLS). We found that, on two of the datasets studied, very small window sizes (4 samples) led to the lowest prediction errors. The RF-PLS method offered the lowest onestep-ahead prediction errors compared to those of the other methods, and demonstrated greater stability at larger time lags than moving window PLS alone. We found that this method most adequately modeled the datasets that did not feature purely monotonic increases in property values. In general, we observed that linear models deteriorated most rapidly at more delayed model update conditions while nonlinear methods tended to provide predictions that approached those from a simple mean moving window. Other data dependent findings are presented and discussed.
منابع مشابه
Ensemble learning with trees and rules: Supervised, semi-supervised, unsupervised
In this article, we propose several new approaches for post processing a large ensemble of conjunctive rules for supervised, semi-supervised and unsupervised learning problems. We show with various examples that for high dimensional regression problems the models constructed by post processing the rules with partial least squares regression have significantly better prediction performance than ...
متن کاملInvestigating the Utility of Oblique Tree-Based Ensembles for the Classification of Hyperspectral Data
Ensemble classifiers are being widely used for the classification of spectroscopic data. In this regard, the random forest (RF) ensemble has been successfully applied in an array of applications, and has proven to be robust in handling high dimensional data. More recently, several variants of the traditional RF algorithm including rotation forest (rotF) and oblique random forest (oRF) have been...
متن کاملApplication of Breiman's Random Forest to Modeling Structure-Activity Relationships of Pharmaceutical Molecules
Leo Breiman’s Random Forest ensemble learning procedure is applied to the problem of Quantitative Structure-Activity Relationship (QSAR) modeling for pharmaceutical molecules. This entails using a quantitative description of a compound’s molecular structure to predict that compound’s biological activity as measured in an in vitro assay. Without any parameter tuning, the performance of Random Fo...
متن کاملEnsemble Modeling of Mill Load Based on Empirical Mode Decomposition and Partial Least Squares
Reliable measurements of ball mill load parameters and reorganization of the operating statuses are the key factors for saving energy and optimization control. Empirical mode decomposition (EMD) and partial least squares (PLS) are used to analyze shell vibration signal and monitor mill load parameters of ball mill. The shell vibration signal is decomposed into several intrinsic mode functions (...
متن کاملEffectiveness of ensemble machine learning over the conventional multivariable linear regression models
This paper demonstrates the effectiveness of ensemble machine learning algorithms over the conventional multivariable linear regression models including Ordinary Least Squares, Robust Linear Model, and Lasso Model. The ensemble machine learning algorithms include Adaboost, Random-Forest, Bagging, Extremely Randomized Trees, Gradient Boosting, and Extra Trees Regressor. With the progress of open...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره abs/1710.11595 شماره
صفحات -
تاریخ انتشار 2017